


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1985-06 


Cost estimating methods utilized by the 
defense aerospace industry in the production 
of technical data. 


Lemire, Joseph Wilfred Jr. 


http://ndl.handle.net/10945/28080 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 
| (8 D U DLEY research materials and institutional publications created by the NPS community. 
«ist sia Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


NY KNOX appointed — and published -- scholarly author. 

ia) LIBRARY Dudley Knox Library / Naval Postgraduate School 

411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 


DUDLEY KNOX LIBF.ARY 
NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIFORNIA 95943 








NAVAL POSTGRADUATE SCHOOL 


Monterey, California 





THESIS 


Geen ESTIMATING METHODS UTILIZED BY THE 
DEFENSE AEROSPACE INDUSTRY IN THE 
PRODUCTION OF TECHNICAL DATA 


by 


Joseph Wilfred Lemire Jr. 


June 1985 


Thesis Advisor: 





Approved for public release; distribution unlimited 


a ee ee cf 


¥ 


loc +41 O 





UNCLASSIFIED . 


SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered) 





READ INSTRUCTIONS 


REPORT DOCUMENTATION PAGE BEFORE COMPLETING FORM 


1. REPORT NUMBER 2. GOVT ACCESSION NO.) 3. RECIPIENT'S CATALOG NUMBER 


4. TITLE (and Subtitle) S. TYPE OF REPORT & PERIOO COVERED 
Cost Estimating Methods Utilized by the Master's Thesis 

Defense Aerospace Industry in the June 1985 

Production of Technical Data — 6. PERFORMING ORG. REPORT NUMBER 

















7. AUTHOR(s) 8. CONTRACT OR GRANT NUMBER(s) 


Joseph Wilfred Lemire Jr. 





10. PROGRAM ELEMENT, PROJECT, TASK 
AREA & WORK UNIT NUMBERS 


12. REPORT DATE », 
June 1985 
13. NUMBER OF PAGES 


47 


15. SECURITY CLASS. (of thie report) 







9. PERFORMING ORGANIZATION NAME AND ADORESS 


Naval Postgraduate School 
Monterey, California 93943-5100 $ 











CONTROLLING OFFICE NAME AND ADORESS 


Naval Postgraduate School 
Monterey, California 93943-5100 





V1. 














4. MONITORING AGENCY NAME & ADDRESS(if different from Controlling Office) 









ae ~ 





Unclassified 


DECLASSIFICATION/ DOWNGRADING 
SCHEDULE 









[Sas 


16. OISTRIBUTION STATEMENT (of this Report) 


Approved for public release, distribution unlimited 


17. DISTRIBUTION STATEMENT (of the abstract entered in Block 20, if different from Report) 


18. SUPPLEMENTARY NOTES 


19. KEY WORDS (Continue on reverse side if necessary and identify by biock number) 


Cost Estimation 
Technical Data 
Aerospace Industry 


20. ABSTRACT (Continue on reverse aide if neceseary and identify by block number) 


A great deal of attention is currently being focused on 
the Government's purchase of technical data for competitive 
reprocurement. Both legislative and regulatory initiatives 
require contractors to price data and make it available for 
Government purchase. This research examines the methods used 
by defense aerospace contractors to estimate the cost of 
producing their technical data. 


FORM 
DD kes 1473 EDITION OF 1 NOV 65 1S OBSOLETE il UNCLASSIFIED 
S/N = « = SN = — ge ni er ee = ges 
O102- LF- 014-6601 SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered) 


UNCLASSIFIED 


pe ee oe SSS eee 
SECURITY CLASSIFICATION OF THIS PAGE (When Date Entered) 


420 ~ ABSTRACT < (CONTINUED) 


The study, through the use of personal interviews, 
determined that defense aerospace contractors principally 
employ analog and engineering estimating methods. 
Parametric methods are used only for estimating the 
production cost of technical manuals, and as "reasonable- 
ness checks" for estimates developed by either analog 
or engineering means. 


S/N 0102- LF- 014-6601 UNCLASSIFIED 


SECURITY CLASSIFICATION OF THIS PAGE(When Data Entered) 


ot sales | - 


Approved for public release; distribution unlimited. 


Cost Estimating Methods 
Utilized by the Defense Aerospace Industry 
in the Production of Technical Data 


by 
Joseph Wilfred Lemire Jr. 


Lieutenant, United States Navy 
B.B.A., University of Massachusetts, 1974 


Submitted in partial POE Panent Ol tie 
requirements for the degree of 


MASTER OF SCIENCE IN MANAGEMENT 


from the 


NAVAL POSTGRADUATE SCHOOL 
June 1985 


ABSTRACT 


A great deal of attention is currently being focused on 
the Government's purchase of technical data for competitive 
reprocurement. Both legislative and regulatory initiatives 
require contractors to price data and make it available for 
Government purchase. This research examines the methods used 
by defense aerospace contractors to estimate the cost of 
producing their teehnwesiecara. 

The study, through the use of personal interviews, 
determined that defense aerospace contractors principally 
employ analog and engineering estimating methods. Para- 
metric methods are used only for estimating the production 
cost of technical manuals, and as "reasonableness checks" 


for estimates developed by either analog or engineering means. 


ee. 


TABLE "6m CONTENDS 


INTRODUCTION ----------------------------------+-- 7 
A. RESEARCH OBJECTIVE -------------------------- 7 
e, BEISIDA CE ORS oC =e ee eee 7 
C. SCOPE, LIMITATIONS AND ASSUMPTIONS ---------- 8 
1. Scope -------+--------- ee eee 8 
2. Sime cations —--—-—=——------~-—-—.—~....~..—~=-- 9 
3. Assumptions ----------------------------- 9 
De RESEARCH Ee DCC Ce — ~~ — ------ 9 
E. ORGANIZATION OF THE REPORT 3-99-3723 3--------- 10 
BACKGROUND AND THEORETICAL FRAMEWORK ------------ oe 
A NRO UICULIRC I ee lial 
B. THE GOVERNMENT VIEWPOINT -------------------- Wal 
oR THE INDUSTRY VIEWPOINT "99-99-9923 3-3r rte Ve 
De A BALANCE OF INTERESTS ------22-------------"- 13 
E. DEFINITION, REGULATIONS, AND POLICIES ------- ILS 
1. Department of Defense Federal 
Aequisition Regulations Supplement ------ 15 
2. Department of Defense Instruction 
5010.12 --------------------------------- 17 
3. Contract Data Reauirements List --------- 18 
4. Recent Initiatives ---------------------- 19 
F. GENERIC COST ESTIMATING METHODS ------------- 20 
1. Parametric ------------------------------ Del 
2. Analog --------------- errr - 21 
3. Engineering ----------9-9e rrr 22 


G. SUMMARY ------------------------------------= 22 


III. DEFINITIONS, FUNCTIONS, COST E2EEMEN ts AND 


ENVIRONMENTAL FACTORSEe == === ee = —— ee 24 
jee INTRODUCTION a Se 24 
B. DEFINITION OF TECHNICAL DATA ---=------------- 24 
C. TYPICAL FUNCTIONS ———————— === s = 26 
D. TYPICAL COST ELEMENTS ----------------------- 28 
E. ENVIRONMENTAL FACTORS ----- ee ee =! | eee 
EF. ANAL YS 0S —— aa mm 33 
G. SUMMARY ------------------------------------- 35 
Iv. COST ESTIMATING METHODS ------------------- ieee 55 
A. INTRODUCTION St i a a ee eee 35 
B. PRACTICAL ESTIMATING METHODS ---------------- 35 
1. Analog ---------------------------------- 35 
2. Engineering ----------------------------- 3 6. 
3. Parametric ------------------------------ 36 
C. ANALYSIS -—--------._.-——— 5 oy 
D. SUMMARY ------------------------------------- 38 
V. PRINCIPAL FINDINGS, CONCLUSIONS, AND 
RECOMMENDATIONS =<-<<--<-====—=5— 8 ee ee 39. 
A. PRINCIPLE FINDINGS AND CONCLUSIONS ---------- Si) 
B. RECOMMENDATIONS ---==----—-——_-—_=_--=---_--_--= 40 
C. RECOMMENDATIONS FOR FURTHER RESEARCH -------- alt 
D. ANSWERS TO RESEARCH QUESTIONS --------------- 41 
LIST OF REFERENCES ------------------------------------ 45 
INITIAL DISTRIBUTION LIST ----------------------------- 47 


if NL ROpUCTION 


A. RESEARCH OBJECTIVE 

Government purchase of technical data for competitive 
reprocurement iS an issue that is currently in the forefront 
of the defense acquisition arena. Both legislative and 
regulatory initiatives have recently been drafted that require 
defense contractors to price their aad and make Pera 1 - 
Ae for purchase by the Government. yet within Government 
procurement circles, a methodology to determine what techni- 
cal data shoultd cost does not exist. RABE eionally, there 
is no established cost data base that permits the comparison 
and evaluation of technical data price proposals. To evalu- 
ate a proposed price for technical data, Government analysts 
should first understand what functions are performed in 
producing technical data, what the cost elements of those 
functions are, what environmental factors affect those ele- 
ments, and what cost estimating methods are utilized. The 
purchase of this research was to determine what functions, 
cost elements, environmental factors, and estimating tech- 


nigues are common to defense aerospace contractors in the 


Peoduction of technical data. 


Pee Reo EARCH QUESTIONS 
Given the preceding objective, the following primary 


research question was posed: What methods are used by the 


defense aerospace industry to estimate the cost of techni- 
Cal dae | 

The following subsidiary research questions were con- 
Sidered pertinent in addressing the primary question: 


1. What is technical data within the defense aerospace 
industry? 


2. What are the functions that must be performed in 
order to produce technical data? 


3. What are the cost elements involved in producing 
technical data? 


4. What are the environmental factors that influence 
the cost elements of technical data? 


5. What methods or techniques are used by the defense 


aerospace industry in estimating the cost elements 
of technical data? 


C. SCOPE, LIMITATIONS, AND ASSUMPTIONS 

lL. Seore 

This study was confined to the investigation of 

estimating methods utilized by the defense aerospace industry 
in the production of technical data. The subject of pricing 
technical data was not examined; rather emphasis was placed 
on estimating the costs of technical data production. No 
prior studies of technical data cost estimating methods could 
be found in searches of the literature base. Consequently, 
this researcher relied on personal interviews to obtain the 
majority of his data and information. The results of this 
research provide the reader with an overview of prevalent 


functions, cost elements, environmental factors and estimating 


techniques utilized by the defense aerospace industry in 
the production of technical data. 
Za Limitations 
The number of defense aerospace contractors visited 
by this researcher was limited to five. Within those five, 
a total of twenty eight individuals in various departments 
were interviewed. It was felt that this number was suffi- 
cient to allow the researcher to establish a baseline of 
findings that apply to the aerospace industry as a whole. 
This study was further limited by the lack of prior research 
in the area of technical data cost estimation. This made it 
difficult for the researcher to develop starting points for 
data gathering that were common to the entire industry. 
3. Assumptions 
The presumption underlying this entire research 
effort is that defense aerospace contractors do have a 
method of estimating their cost of producing technical data. 
This study also assumes that the reader has a general 
knowledge of Department of Defense contracting language and 


the Defense acquisition process. 


D. RESEARCH METHODOLOGY 

The research methodology utilized in this study con- 
Sisted of an examination of the literature base through the 
Defense Logistics Studies Information Exchange (DLSIE), 


the Defense Technical Information Center (DTIC), and review 


of various journals and periodicals concerning the federal 
acquisition process. In addatiien, personal interviews were 
conducted with twenty eight employees of five major defense 
aerospace contractors. Individuals interviewed included 
program managers, contract managers, financial managers, and 
engineering/technical division managers. The interviews 
commenced with asking the subsidiary research questions. 
Follow-on questions were then posed based on responses to 


the initial questions. 


E. ORGANIZATION OF THE REPORT 

This report takes the reader through the subject ina 
logical manner. Chapter II presents such background infor- 
mation as the issues surrounding the ownership of technical 
data, the definition of technical data, the federal regula- 
tions concerning technical data, and some recent initiatives 
on technical data. It also covers generic cost estimating 
methods common to industry as a whole. Chapters III and IV 
summarize interviewee responses to the research questions 
and highlight conceptual differences between firms. Chapter 


V develops findings, conclusions and recommendations. 
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II. BACKGROUND AND THEORETICAL FRAMEWORK 


A. INTRODUCTION 

This chapter will examine the principal concerns of 
Government and industry regarding the development and use 
of technical data. It will discuss the issues of technical 
data from both the Government and thé contractor viewpoint 
as outlined in recent publications. This chapter will also 
detail the basic concepts, regulations, and policies 
Seerounding the issue of technical data and its cost. A 
definition will be discussed, and several regulatory 
requirements and initiatives will be presented. Finally, 
the most widely accepted, generic cost estimating techniques 


will be presented. 


B. THE GOVERNMENT VIEWPOINT 

Cost is not the sole criterion upon which to base a 
Meeision to buy technical data. Two recent Air Force surveys 
meune that in addition to prace, other factors to be con- 
sidered include the life cycle cost of the system, the 
system's design complexity and stability, and its expected 
[meventory inelife [Refs. 1,2]. 

A major concern of the Government, however, is the cost 
of technical data. The decision to procure data should 


only be made after its cost is carefully weighed against the 


abel 


life cycle cost of the equipment to which it pertains, and 
the savings expected to result from competition. 

If the purpose of reprocurement data is to achieve 
the advantages of competition and the resultant pro- 
curement dollar savings, then the cost of reprocurement 
data is a vital element in the determination of 
whether or not to buy reprocurement data. In other 
words, excess dollars spent for reprocurement data 
reduce or eliminate the savings from ownership of 
reprocurement data. [Ref. 3] 

One of the principal reasons why the Government wants 
technical data is for the repair, training, and Sueeenr 
functions that must be developed for any system that it 
purchases. Much of the equipment that the Defense Department 
procures is operated and maintained in remote areas, far 
from the manufacturer. An internal support system must be 
constructed for each item of equipment. Technical data is 
required from the supplier for the Government to develop 
and maintain this support system. The functions within this 
support system include personnel training, equipment main- 
tenance and overhaul, spare parts cataloging, inspection 
andsg@uality control, and packaging and logistics Ssuppore 
Without technical data, these functions cannot be fully 
developed and implemented. 

Finally, the most controversial reason wmy the Governmenme: 
desires technical data is for competitive procurement. 

While most of the Government's requirements can be met by 


accepting data with restrictions, it is when data must be 


obtained for competition that the debate arises. 
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...the Government must make technical data widely avail- 
gyeeein the form of Comtract specifications in order 
to obtain competition among its suppliers, and thus 
further economy in Government procurement. [Ref. 4] 
The Government's desire to achieve economy through competi- 
tion is in direct contrast with industry's desire to 


retain a competitive edge. 


feels INDUSTRY VIEWPOINT 

The principal reason why industry’ retains technical data 
is to maintain a competitive edge over‘competitors. If 
providing technical data to the Government could possibly 
eliminate that edge, industry will, quite naturally, be 
meluctant. 

Commercial organizations have a valid economic 
interest in technical data pertaining to items, com- 
ponents, or processes which they have developed at 
their own expense. Such technical data is often closely 
held because its disclosure to competitors could 
jeopardize the competitive advantage it was developed 
to provide. Public disclosure of such technical data 
can cause serious economic hardship to the originating 
company. [Ref. 4] 

In some cases, the data could be critical to the continued 
existence of the firm. However a contractor's desire to 
protect technical data is only one of many internally 
competing interests. A company may be willing to deal with 


mmemGcovernment over technical data if that firm sees the 


potential for profit from the sale of such data. 


D. A BALANCE OF INTERESTS 
The Department of Defense Federal Acquisition Regulations 


Supplement (DOD FAR Supplement) recommends that a balance 


1S 


be struck between the interests of the Government and those 
of industry. 


— 


It is apparent that there is no necessary corre- 
lation between the Government's need for technical 
data and its contractors’ economic interest therein. 
However, in balancing the Government's requirements 
for technical data against the contractor's interest 
in protecting his technical data, it should be recog- 
nized that there may be a considerable identity of 
interest. This is particularly true in the case of 
innovative contractors who can best be encouraged to 
develop at private Gxpensegatems Of mm irarweisermemca. 
where their rights in such items aré scrupulously 
protected. [Ref. 4] 

At times, it is in the best interests of both the 
Government and industry to protect technical dalam ves 
both innovative and militarily useful. Without this pro- 
tection, industry woulld not be inclined to make technologi- 
cal breakthroughs. Additionally, the Government should 
restrict its procurement of technical data to that which is 
actually needed. This policy will ensure a continued flow 
of data from industry and also control the costs of data 
Maintenance, storage and retrieval. When technical data is 
desired, the Government should weigh its cost against other 
factors, such as the item's life cycle cost, design com- 
plexity and stability, and its expected inventory life. 


By making this evaluation, the Government will only procure 


technical data when it makes good sense. 
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PS ae eeaeNT TION, REGULATIONS. AND POLICIES 


l. Department of Defense Federal Acquisition 
Regulations Supplement 


Prior to any discussion, a definition of what techni- 
cal data is, must be established. Since the Federal 
Acquisition Regulations (FAR) are silent on the matter, the 
Department of Defense Federal Dec RRS Regulations 


Supplement (DOD FAR Supplement) must be utilized. DOD FAR 


| 


Supplement provides the following definition of technical 
data: 


Technical Data means recorded information regard- 
fame OL form Or chasacteristic, of a»ysemsertific: or. 
technical nature. It may, for example, document re- 
search, experimental, developmental or engineering 
work; or be usable or used to define a design or 
process or to procure, produce, support, maintain, or 
operate materiel. The data may be graphic or pictorial 
delineations in media such as drawings or photographs; 
text in specifications or related performance or design 
type documents; or computer printouts. Examples of 
technical data include research and engineering data, 
engineering drawings and associated lists, specifica- 
tions, standards, process sheets, manuals, technical 
reports, catalog item identifications and related 
information, and computer software documentation. 
Technical Data does not include computer software or 
financial, administrative, cost and pricing, and 
management data, or other information incidental to 
contract administration. [Ref. 4] 


Although very fundamental, this definition estab- 
lishes the idea that technical data is a broad concept that 
encompasses many peerent products. For the purposes of 
this study, the researcher has adopted the following defini- 
tion of technical data: recorded information regardless of 


mem Or Characteristic, of a scientific or technical nature. 


is 


The following are examples of various kinds of data: research 
and development data, design disclosure data, quality assurance 
data, installation and maintenance data, operating data, 
manufacturing data, and configuration management data. It 

is readily apparent that technical data consists of a broad 
spectrum of information in a diverse number of formats. 

There are four possible data policies that may be 
pursued by the Government. They are:* full data with un- 
limited rights, full data with limited:rights, limited data 
with full rights and limited data with limited rights. A 
full data with unlimited rights policy requires Ehescontraceen 
to deliver, without restrictions, all data generated under 
the contract. This permits the Government to use the data 
for competitive reprocurement. A full data with limited 
rights policy allows the contractor to place restrictive 
markings on data considered proprietary. The Government 
can only use the restricted data for internal purposes. A 
limited data with full ra@gnts policy requilees Ene comm acue. 
to deliver all unrestricted data, but he can withhold any 
that is proprietary. Lastly, a limited data with limited 
rights policy requires that any data delivered to the Govern- 
ment be free of restrictions. Any proprietary information 
is allowed to be withheld by the contractor. However, if 
the contractor is ordered to deliver the restricted data, it 
is understood that the Government will accept it with 


restrictive markings. In the past, the basic policy of the 
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Government has been to obtain full data with limited rights 
[Ref. 5]. With the current emphasis on obtaining competition, 
however, the Government is turning more toward the acquisition 
er £ull! data wath unlimited raghts. 
eee OoreEment of sDefensesinstructirenes010..12 

This instruction provides the same basic definition 
of Technical Data as found in DOD FAR Supplement, but goes 
@n to add that the first step in establishing the data 
requirement is a Determination of Intended Use: 

Personnel representing program management, engineer- 
ing, procurement, training, maintenance, operations, 
iegrvstics support and other functional areas will 
determine the content and intended use of technical data 
in consonance with the responsibilities assigned to the 
Program or Project Managers and the needs of the 
Specific project. 

Consideration shall be given to materiel readiness 
and operational planning factors which led to generating 
the requirements for a specific system, end item, 
equipment, material or service to which the required 
data relates. [Ref. 6] 

Program personnel review each aspect of the system to be 
developed and attempt to determine the level of data required. 
Mires instruction also provides different factors to consider 
when making the determination. They include such things as 
whether the item is for a single installation with no addi- 
ueom@e procurement anticipated, whether the item is "one- 
of-a-kind" with no planned production, or whether it could 
progress from development all the way to final production, 


and whether it is a "breakout" candidate. This procedure 


is becoming more critical in light of recent initiatives 


Ly 


to obtain data from contractors for the purpose of competi- 
tive reprocurement. 
3. Contract Data Requirements List (DD Form 1423) 

The Defense Aerospace Contractors anterviewed by 
this researcher frequently mentioned the Contract Data 
Requirements List (CDRL) when discussing technical data. A 
presentation of the CDRL is necessary here since it will be 
referred to repeatedly ia subsequent Chapters. The CDRL a 
used by the Government to delineate all deliverable data 
requirements. Its use is required by DODI 5010.12. The 
pricing of each line item on the CDRL provides the Government 
with a means of weighting the cost of the data against its 
perceived worth. The price of the data should be based on 
the "over and above" concept; that is, it should be based on 
what it cost the contractor to produce the item for the 
Government, over and above what it would have cost if the 
item were produced solely for the contractor's internal 
use [Ref. 7]. Four price groups are recognized in the 
application of the "over and above" concept. They are: 

Group I--Data prepared solely for the Government's 
use, that the contractor would otherwise 
not have prepared. 

Group II--Data necessary for contract performance 
that must be modified to meet the require- 
ments of the Government. 

Group III--Data the contractor develops for his own 
use which needs no modification prior to 


submission to the Government. 


Group IV--Data developed by the contractor for use 
in the commercial arena. 


de: 


4. Recent Initiatives 

The issue of technical data has arisen frequently 
in the recent past. The forum in which it has been raised 
gives an indication of the level of interest technical data 
has reached within Government. The following are some of the 
more recent legislative proposals and regulatory guidances 
that have been issued. 

The 1984 Department of Defense Authorization Act 
contained a provision that prevented the obligation or 
expenditure of any funds for a certain laser aquided projec- 


mere until: 


ad aa 


...the Secretary of the Navy has acquired a technical 
data package for that projectile and has determined 
that such technical data package (1) does not contain 
proprietary data, and (2) can be used to solicit a 
second production source for such projectile. [Ref. 8] 


In February 1984, H.R. 4842 was introduced in the 
House of Representatives. This bill would have required a 
Paragraph in procurement contracts specifying a time limit 
after which the contractor would: 
..-grant the agency rights to the use of any technical 
data...pertaining to parts and components to be de- 
livered to the United States under the contract that 
are subject to replacement. The technical data... 
covered shall provide adequate, complete, and usable 
information so as to allow subsequent competitive 
procurement of such parts or components from another 
competent manufacturer. [Ref. 9] 
Under this bill, the maximum time for the transfer to occur 
would be seven years. 


felthougn H.R. 4642 was@reyected in conference com- 


mittee, the Department of Defense Authorization Act for 
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fiscal year 1985 contains a provision that allows the 
Secretary of Defense to establish a contractual time limit 
of not more than seven years for the transfer of technical 
data to the Government. 

In May 1984, the Chief of Naval Material issued a 
memorandum as an advance change to the Navy Acquisition 
Regulation Supplement. It created a clause entitled "Acqui- 
sition of Unlimited Rights in Technical Data and Computer 
Software." A portion of that clause states: 

...the Contractor agrees to submit a firm fixed price 
proposal for each item listed in Attachment 1 and to 
enter «Into good faith negotiations to establish prices. 
In the event of failure to agree on a price, the PCO 
may, with the approval of the Head of the Contracting 
activity, determine a reasonable price, subject to 
appeal by the Contractor in accordance with the 
"Disputes" clause of this contract. [Ref. 10] 
The "Attachment I” rererred to in the texe 1s 2 (ie ue 
items which the contractor intends to deliver with limited 
rights. This memorandum clearly demonstrates that the Navy 
intends to aggressively pursue the procurement of technical 


data. Defense contractors are on notice that they will 


provide ite 


F. GENERZTG COST ESTIMATHIG Me Lere 

In subsequent chapters, reference will be made to cost 
estimating methods utilized by Defense Aerospace Contrac- 
tors. In order to familiarize the reader with these estimat- 
ing techniques, the three "major methods" as described by 


C.A.»Batchelder will be discussed [-:) Lae 
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= Panawetric 
The first and most prevalent means of cost estimat- 
ing 1s the parametric method. It employs known estimating 
relationships between variables such as weight, speed, power 
or thrust, and cost, as expressed in dollars. Frequently 
referred to as Cost Estimating Relationships, or CERs, these 
known relationships are then applied to the parameters of 
the new system to develop a’cost estimate [Ref. 11]. For 
example, in the area of airframe manufacture, known cost 
estimating relationships exist in terms of dollars per pound 
of weight, per pound of thrust, and so forth. These rela- 
tionships are used with the variables of a new airframe to 
develop its estimated cost. 
2. Analog 
The analog method of estimation is based on a com- 
parison of the new system with a prior one. Although the 
two are not identical, an estimate is made by considering 
their likenesses and differences in design and performance 
[Ref. ll]. For example: 
The use of new structural material for aircraft 
often requires the development of special cutting and 
forming techniques with manufacturing labor require- 
ments that differ significantly from those based ona 
sample of primarily aluminum airframes. Faced with 
this ‘problem when titanium was first considered for 
use in airframe manufacture, airframe companies 
developed standard-hour values for titanium fabrica- 
tion on the basis of shop experience in fabricating 
test parts and sections. [Ref. 11] 
In this instance, the experience obtained while 


fabricating test parts and sections was considered analogous 


to the effort necessary to build the entire airframe. 


Zu 


3. SBngineering 
The final method is called the engineering method. 

It involves breaking down the system into separate segments 
of work. These segments are then examined at a low level of 
detail and estimates are made for each. The detail esti- 
mates are then consolidated into a total estimate for the 
overall system [Ref. 11]. This method is normally used when 
a thenough, detailed analysis is required for all the 
processes involved. When defense aerospace contractors 
employ the engineering method of cost estimating, they fre- 
quently use a Work Breakdown Structure (WBS) to develop 
it. The WBS is defined in Military Standard 881A as: 

...a produce-oriented family tree composed of hardware, 

services and data which result from project engineering 

efforts during the development and production of a 

defense materiel item, and which completely defines 

the project/program. A WBS displays" and defines cme 

product(s) to be developed or produced and relates 

the elements of work to be accomplished to each other 

and to the end product. [Ref. 12] 
The WBS is organized in levels, each of which is comprised 
of a number of elements. A cost is estimated for each 


component element and totaled at each level. An overall 


estimate consists of the total of all the levels. 


G. SUMMARY 

This chapter outlined the concerns regarding the 
development and use of technical data. The issues from 
both the Government and industrial viewpoint were discussed. 


The concept of striking a balance between Government and 


Ze 


industry requirements was presented. A definition of 
technical data was established, and the different regulations, 
laws and policies surrounding the subject were reviewed. 


Finally, a description of the most prevalent cost estimating 


methods was presented. 
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III. DEFINITIONS, FUNCTIONS, COST ELEMENTS, 
AND ENVIRONMENTAL FACTORS 

A. ZINTRODUCTION 

This chapter will present contractor respons-smeom rune 
First four research questions. The following chapter will 
detail their answers to the final research question. | Twenty 
eight individuals within five major defense aerospace firms 
were interviewed. To encourage a frank and open exchange, 
this researcher promised that all statements would be non- 
attributable. Therefore, nothing in this study has been 
ascribed to any particular individual or company. Different 
responses to the same questions are combined to form aggre- 


gate observations. 


B. DEFINITION OF TECHNICAL DATA 

Research question: What is technical data within the 
defense aerospace industry? 

A multitude of interpretations were provided as defini- 
tions of technical data. The responses, however, can be 
segregated into two general types. The first comprises a 
large list of specific items considered by the contractors 
to be elements of technical data. Among the most common 
items identified were: drawings of all kinds (such as 
engineering, interface, process, and assembly drawings), 
computer software, design information specifications, 


process specifications, configuration management data, 
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provisioning technical documentation, technical manuals, and 
test documentation. The list also includes customer required 
reports such as performance reports, analysis reports, 
"<jlity" reports (reliability, maintainability, survivability, 
etc.), safety reports, technical reports, and progress and 
aifencial reports. All of these are considered by. Ehe con— 
tractors to be technical data. The reason for this becomes 
apparent when the second type GE response is @xamined - 

“The second type of response to the’technical data 
definition question was an assemblage of broad interpreta- 
tions. They include such ideas as: "anything not hardware," 
Penyching that “has~to dowwath the end item product,” "any- 
thing that does not comprise administrative data," and 
"everything that has a deliverable requirement." 

The most ‘common, broad-based definition of technical 
data that consistently recurred throughout the interviews 
was "all requirements outlined in the Contract Data Reaquire- 
ments List (CDRL)." As mentioned earlier, since the CDRL 
is used by the Government to indicate reporting requirements 
as well as data requirements, the contractors consider these 
reports to be technical data. But all the reports do not 
meet the Government's definition of technical data in that 
some of them, such as progress and financial reports, are 
completely non-technical in nature. So a dichotomy exists 
between the Government's definition of technical data, as 


outlined in DOD FAR Supplement, and industry's perception 
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of what constitutes technical data (as required in the 


CDR). 


C. TYPICAL FUNCTIONS 

Research guestion: What are the functions that must be 
performed in order to produce technical data? 

It is this researcher's opinion that the creation of 
technical data can be broken down into four distinct phaseee 
generation, capture, documentation and delivery. The 
generation phase involves data creation. It is an abstract 
process which is comprised of the formation of mental cog] 
cepts. In the capture phase, these mental concepts are 
recorded in rough format on an informal medium ene as an 
engineer's notebook. The documentation phase involves the 
structuring of that data into words and drawings. In the 
delivery phase, the technical data is provided to the 
customer via the medium requested; such as magnetic tape, 
manuals, or microfilm. | 

The functions performed during technical data production 
that were most frequently identified by the interviewees are 
analysis, design, recording, and handling. The analysis 
function consists of examining the performance and other 
parameters of the proposed system. A determination is then 
made as to what configurations are necessary to meet those 
parameters. During the design function, the data that will 
incorporate the configurations is planned and outlined. The 


recording function, which occurs in Conjunction wrt design. 
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involves placing the data onto a medium such as drawings and 

; text. Finally, the data is assembled, copied, and distributed 
in the form requested by the customer during the handling 
function. 

Within these four functions, the components of work 
identified by interviewees were the same. Those most often 
mentioned included drawing, drafting, composing, word 
processing, reproduction, printing, ahd reformatting. One 
interviewee expanded his interpretation of the functions 
performed in the production of technical data. He stated 
Ege depending on the particular function that was in effect, 
the components of work internal to that function would vary 
in intensity. For example, the early life of a project 
consists mainly of the analysis function. During that 
analysis, the majority of the costs incurred stem from 
drawing and drafting, with very little printing or reformatting. 
Looking at all five contractors, there were no significant 
differences in functions performed or components of work 
within those functions. These are the four phases and the 
functions performed on technical data as it evolves. It 
should be noted that during the life of a program, this 
process repeats itself whenever configuration changes are 
made to the svstem. The technical data ane reprocessed 
through each phase and every function is performed again in 


order to reflect the changes. 
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D. TYPICALSCOST ELEMEN@s 

Research question: What are the cost elements involved 
in producing technical data? 

The question of cost elements involved in produc ime 
technical data revealed two distinct areas. The first con- 
sists of the cost elements incurred during data production. 
The second area 1S comprised of cost drivers that influence 
the extent to which each cost element is incurred. 

“Interviewees indicated that labor is the first major 
cost element incurred in the data production process. Ex- 
pressed in manhourms, 1t ineludes engineering labor efeanl 
types, supervision, management, quality assurance, planning, 
coordination with the project office and customer, perfor- 
mance tracking, data base initiation and maintenance, vendor 
data acquisition, drawing maintenance, provisioning conferences, 
software maintenance, clerical. support, editing, typing, 
printing and reproduction. Interviewees further stated that 
labor comprises eighty to ninety percent of the total cost 
incurred in technical data production. 

The second cost element is computer time, expressed in 
hours. Although Computer Aided Design (CAD) is still in the 
development stage, it is widely used in the production of 
elementary designs. Many of those interviewed felt that 
CAD will become an increasingly prominent, cost element as it 
becomes capable of handling more complex and intricate design 


fFuMmetLons. 
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The third and final cost eAene is.material. The 
majority of material expenses consist of paper and other 
Gftice supplies, as well as reproduction and printing 
consumables. The amount of material used in the production 
of technical data is largely a function of the frequency 
and quantity of data and report submissions required by the 
CDRL. | 

a drivers affect the degree to which each cost element 
is ‘incurred. Technical complexity and- performance require- 
ments are both strong cost drivers. A high speed, multi- 
mission fighter-bomber, for example, has more electronic 
interface requirements, is more technically complex, and has 
higher performance requirements than those of a trainer 
aircraft. Technical complexity and high performance require- 
ments result in the creation of a large quantity of technical 
data to support that system. Another strong cost driver is 
the amount. of computer software reguired for a system. The 
number and complexity of programs needed to run the various 
computers on an adwerail: adds directly to the amount of 
Meemnical data needed to support that aircraft. A final 
cost driver is new requirements or changes that are enacted 
after commencement of system development. This is the 
strongest cost driver of all because it involves the costly 
and time-consuming process of redesign. Interviewees said 
Meme 1S difficult to accurately estimate the cost of a 


redesign effort. They stated that normally they resort to an 


Ze 


audit of the entire data package for each design change in 
order to determine the number of drawings and pages of data 
that are affected. An estimate is then made of the manhours 
and other cost elements necessary to implement that change. 
Figure 1 illustrates the effect cost drivers have on the cost 


elements. 
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Figure 1. Effect of Cost Drivers on Cost Elements 


In comparing all five contractors, differences in cost 
elements identified were based on the relative position of 
the interviewee in his organization. Those in supervisory 
positions tended to interpret cost elements as specific 
items that could be identified to a partieular 700, suc ioe 
drafting or reproduction. Whereas individuals in managerial 


positions thought of cost elements in much broader cerns 
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such as preparation, administration, and release. Between 
all five firms, however, the major cost elements of labor, 


computer time, and material remained the same. 


E. ENVIRONMENTAL FACTORS 

Research question: What are the environmental factors 
that influence the cost elements of technical data? 

Petacge number offsesponses were received eweut envyiron— 
mental factors that influence data cost elements. From 
these, the researcher combined a number of similar ones, 
Beemouclined the most frequent and influential ones. For the 
purposes of this study, environmental factors are defined 
as those things that can influence the level of cost elements 
ieeeened, but are not directly controlled by the contractor 
nor included in his initial cost estimate. 

The He ati iess of environmental factors mentioned are 
directly related to the CDRL. One factor frequently men- 
tioned was ambiguous CDRL reguirements. The ambiguity 
results when it is not clear what a certain report is sup- 
posed to contain, or when the costs incurred while gathering 
information for a report would exceed the worth of that 
information. Interviewees indicated that the issue is 
negotiated to produce a dese costly item, yet something that 
still meets the needs of the customer. 

A second CDRL item mentioned by interviewees was prema- 


ture requirements. Contractors are sometimes required to 
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submit drawings and reports to the Government before the 
design is fully stabilized. This results in multiple nee 
and comment cycles which, in the interviewees' opinion, causes 
the system design to remain unstable for a much longer period 
of time. 

Another problem cited by an interviewee was that CDRL 
requirements do not keep pace with advances in technology. 
This results in requirements that can*no longer be met, as 
the’ system design has been changed to incorporate the new 
technology. Since the CDRL requirement is still structured 
around the previous design, the contractor must negotiate 
with the customer to develop ones that are tailored to the 
new design. Interviewees stated that in many cases, this 
causes them to incur additional expenses that elevate their 
original cost estimate. 

Changes to technical data were mentioned previously as a 
cost driver. One interviewee considered the quantity of 
changes to be an environmental factor because many of them 
are customer driven. He estimated that the audit resulting 
from each change usually increases the cost of the original 
data package by sixty to seventy percent. 

When speaking of environmental factors, all those inter- 
viewed had a perspective that encompassed only customer 
actions that influence the production cost of technical data. 
Only one person admitted to another influence; that of other 


governmental (state and local) laws and regulations. None 


SZ 


of the interviewees considered their firm's internal actions 


as environmental factors. , 


F. ANALYSIS 

Studies found in the literature base by this researcher 
are principally concerned with the Government's desire for 
technical data transfer, and the reluctance of contractors 
jm allow it. ‘These issues were presented in Chapter II. No 
studies were found that explore the underlying concepts of 
what the functions are that produce Pesca data, what 
their cost elements are, and what influences those elements. 
The interviews conducted by this researcher indicate that 
defense aerospace contractors are fully aware of these 
issues. As the Government requires more technical data 
transfer in the interest of competition, it is the opinion 
of this researcher that Coaenmene analysts will want to 
know more about data production functions and their associated 
costs. The interview results presented in this chapter are 
a first look at these concepts. More studies and analyses 
are needed in order to expand the information base in this 


akeea. 


G. SUMMARY 

This chapter presented findings to the first four re- 
search questions. It examined how aerospace contractors 
defined technical data and identified the typical functions 


performed in data production. The cost elements involved 
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were then separated into elements and drivers. Finally, . 
various environmental factors that influence the cost 


elements were identified. 
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ive SeGear ESTIMATING METHODS 


A. INTRODUCTION 

This chapter will discuss the cost estimating methods 
common to the defense aerospace mater, in” tier oroduct ron 
of technical data. Each type of estimating method is pre- 
sented with statements regarding its relative importance. 
Finally, an analysis of these methods is presented, with a 


discussion of the rationale for their use. 


B. PRACTICAL ESTIMATING METHODS 
1. Analog 

The most prevalent technique of cost estimating the 
production of technical data within the defense aerospace 
industry is the analog method. The data to be produced is 
first compared with a recent project to determine if there 
are any common elements. If it is found that a significant 
portion of the new system is similar to a former one, then 
the hours of effort and material expended to produce the 
previous data are used as a base estimate. Differences in 
the design and performance of the two systems are then con- 
Sidered. Estimates are made for these and added to the base. 
Interviewees stated that the analog method was their preferred 
technigue simply because it is the quickest and simplest. 


They said that their normal mode of operating includes budget 


35 


and time constraints. In their opinion, analog estimating 
provides them sufficitrent accuracy for the least cost in 
the shortest time. 
IX. Engineering 

When the data to be developed cannot be fitted to an 
analogy, interviewees indicated that they utilize the engineer- 
ing method of estimating. There are two prevalent situations 
for using this method. The '’first is when the data to be 
produced is for an entirely new system. The second is when 
the contractor is new to the business and has no cost data 
base with which to develop an analog estimate. Interviewees 
stated that the Work Breakdown Structure is frequently used 
to reduce the system to its lowest elements. Bottom up 
estimates are then made within each department that partici- 
pates in data development. These estimates are then aggre- 
gated into a total for the entire technical cata package. 
Interviewees statedthat this method is more expensive than 
the analog method because it requires more time and personnel. 
Each department that participates in the production effort 
must formulate a cost estimate on the elements it works on. 
A large amount of managerial effort is also necessary to 
coordinate the entire estimating process. 

3. Parametric 

This researcher found that parametric estimating of 

technical data production costs is the method least employed 


among defense aerospace contractors. The consensus of those 
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interviewed was that parametric COSeEmesStimakes demnot provide 
et eae G umacy, for internal budget control. CGonstamt changes 
in technology invalidate cost estimating relationships 

faster than new ones can be developed. Only the technical 
Manual departments of the contractors visited consistently 
relied on parametric estimating methods For any type of 
manual (maintenance, training, etc.), department managers 

have determined from personal experience that historical 

costs are consistent enough to permit parametric estimating. 
One contractor, for example, has a classification system 
comprised of three different levels of technical data: 

"new, revised," and "lift." Each classification has a pre- 
determined rate for every cost element utilized in the 
technical manual production process. The "new" classification 
is used for "first time" data development. It contains the 
highest rates for cost elements. The "revised" classification 
contains a lower level, because much of it is derived from 
previous projects. The "lift" classification has the lowest 
cost rates, as it is taken from a prior system and is com- 


prised entirely of reproduction effort. 


Se eaNALYSIS 

Interviewees stated that their preference for any one of 
the three estimating methods (analog, engineering, or 
parametric) is based on a number of considerations. The 
first is whether the contractor has an existing experience 


base from which to draw an analogy to the new system. If he 
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does, then the analog method is employed. If he does not, 
then the manager considers what other estimating method will 
provide accuracy yet be expedient and relatively inexpensive. 
For technical data production, interviewees stated that, 

from their experience, the engineering method was their 

next choice; simply because it provided more accurate cost 
estimates than parametric methods. Interviewees admitted 
that the engineering method was more time consuming and 
expensive than parametric estimating. ‘However, in their 
Opinion, the accuracy of an engineering estimate consistently 
exceeded that .of. a parametric estimate. 

Only one contractor used the engineering method as a 
primary estimating technique. The reason for this was that 
the firm was relatively new to Government contracting, and 
did not have a historical cost data base upon which to make 
analogous estimates. Personnel interviewed pointed out that 
they were aware of this fact and planned to employ analog 


estimating as soon as practical. 


D. SUMMARY 

This chapter discussed the cost estimating methods 
prevalent in the defense aerospace industry for the produc- 
tion of technical data. Each method was presented with 
reasons for its employment. Finally, an analysis was made 
of the decision process defense aerospace contractors employ 


in deciding which estimating method to use. 
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Veen teres FINDINGS ,- CONCLUSIONS, 
AND RECOMMENDATIONS 

A. PRINCIPAL FINDINGS AND CONCLUSIONS 

The objective of this study was to determine what cost 
estimating methods are utilized by defense aerospace con- 
Peacters in the production of technical gata wethe sor ined pal 
Findings and conclusions are derived from opinions received 
in personal interviews. 

1. A dichotomy exists between the Government's definition 
one technical data as outlined in DOD FAR Supplement, and 


are driven by CDRL requirements. They consider anything 
that is listed in the CDRL to be technical data. This per- 
ception contrasts with the DOD FAR Supplement definition of 
technical data. 

2. The cost of producing technical data has two distinct 


@meas: Cost elements and cost drivers. Cost elements are 
specific types of expense, such as labor, computer time and 
material. Cost drivers influence the degree to which each 
expense type is incurred. They include such things as 


technical complexity and performance requirements. 


3. The majority of defense aerospace contractors inter- 
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Viewed feel that environmental factors (that influence the 
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from the customer. Most of the environmental factors 


mentioned were directly related to the CDRL. 


4, The analog method is the first choice of defense 
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data production. This is the preferred method simply 
because it is quick and simple, yet provides accuracy. 


5. The engineering method is the second choice of 
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technical data production. Admittedly. more expensive, this 
method is employed for its accuracy when analog methods 
cannot be used. : 

6. Parametric estimating is only Used or reco oe 
mates developed by analog or engineering methods. Cost 
estimating relationships are continuously invalidated as 


advances in technology are made. They do not provide enough 


accuracy for internal budgeting purposes. 


B. RECOMMENDATIONS 


1. CDRL requirements should be clearly delineated in 
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order to reduce ambiguity and misunderstandings. Currently, 
CDRL requirements are not clearly understood. This results 


in delays and misunderstandings on the part of the contractor. 


2. The Government should divorce non-technical reporting 
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technical data to include non-technical items. Defense aero- 
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Space contractors consider anything that appears on the 
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CDRL as technical data. Yet the CDRL is used by the Govern- 
ment to require many non-technical reports. This disparity 
should be cleared up by segregating the non-technical re- 
quirements, or by modifying the DOD FAR Supplement definition 


of technical data. 


GC. RECOMMENDATIONS FOR FURTHER RESEARCH 

There is general agreement among the defense aerospace 
B@ismuactOrs interviewed that a relationship exists between 
the cost elements, cost drivers and environmental factors of 
technical data production. However, there is no prior 
research neve. siclbiseeneger ayes this claim. It is therefore 
recommended that a study be conducted of these cost elements, 
cost drivers, and environmental factors. The focus of this 
study should be to quantify the relationships between them 
and determine the degree of sensitivity each cost element 
has with respect to each cost driver and environmental 
Factor. Once the relationships and sensitivities are estab- 
lished, a range of probabilistic variances can be determined 
by reviewing historical cost data. The following matrix 


illustrates the relationship. 


D. ANSWERS TO RESEARCH QUESTIONS 
As a summary of the information presented, the following 
is a restatement of the primary and subsidiary research 


questions and their answers. 
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Matrix of Cost Elements, 
and 
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Figure 2. 


Primary research question 
Question: What methods are used by the defense aerospace 
Spe einsecy. to estimate the cost of technical data? 
Answer: In order of preference, the five defense aerospace 
contractors interviewed utilize analog methods, engineering 


methods, and parametric methods (for technical manuals and 


Gem reasonableness checks"). 


Subsidiary research questions 
Question: What is technical data seen the defense aero- 
Space industry? 
Answer : Based on responses from those interviewed, the 


prevalent definition of technical data is all requirements 


outlined on the CDRL. 


Question: What are the functions that must be performed in 
order to produce technical data? 
Answer: The four functions performed to produce technical 


data are analysis, design, recording and handling. 


Question: What are the cost elements involved in producing 
technical data? 

Answer: The prevalent cost types are labor, computer time 
and materials. These are influenced by cost drivers such as 
technical complexity, performance requirements, software 


requirements and changes/new requirements. 
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Question: What are the enyironmental factors that influence 
the cost elements of technical data? 

Answer: From the perspective of defense aerospace con- 
tractors, the majority of environmental factors are directly 
related to the CDRL. They include ambiguous requirements, 
premature requirements, and requirements that lag behind 


technology. 


Question: What methods or techniques are used by the defense 
aerospace industry in estimating the — elements of 
technical data? 

Answer: In order of preference, the estimating methods 
utilized within the defense aerospace industry are analog 
methods and engineering methods. Parametric methods are only 
used to estimate technical manual cost elements and as 


"reasonableness checks" for analog or engineering estimates. 
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